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Abstract 

We study a one-dimensional Markov modulated random walk with jumps. It is assumed 
that amplitudes of jumps as well as a chosen velocity regime are random and depend on a 
time spent by the process at a previous state of the underlying Markov process. 

Equations for the distribution and equations for its moments are derived. We charac- 
terise the martingale distributions in terms of observable proportions between jump and 
velocity regimes. 
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1. Introduction 

Telegraph processes with different switchings and velocity regimes are studied recently in 
conne c tion w i th possibility of diff e rent a pplications such as, for instance, q ueuing th e ory (s ee 
Zacksl (|2nn4l V IStadie and Zacks I diooi)) and mathema tical biology (se e iHadeler I (Il999l'l'). 
Specia l attention is devoted to financial applications (see Ratanov ( 200?! ) . Lopez and Ratanov 
(|2012l )). In the latter case, an arbitrage reasoning demands the presence of jumps. 

The motions with deter ministic jumps ar e studied in detail, see the form a l expr essions 



of the transition densities in ilil^ B. bi Crescenzo and Martinucci I Such 



a model is d eveloped for the option pricing problem, which is based on the risk-neutral 
approach, see I Ratanov I (j2007l ). If the jump amplitudes are random, the case is less known. 
The telegraph processes of this type are studied earlier only under the assump t ion of mu- 
tual independence of jump values an d jump amplitudes, see IStadie and Zacks I tooi ) and 
Di Crescenzo and Martinucci I (1201311. Si milar setting were used for the purposes of financial 



applications, Lopez and Ratanov ( 20121 ). 



We present here a jump-telegraph process when an amplitude of the next jump depends 
on the (random) time spent by the process at the previous state. This approach is of 
special interest for the economical and the financial applications, everywhere when the 
comportment of process relates with friction and memory. 

Assume that the particle moves with random (and variable) velocities performing jumps 
of random amplitude whenever the velocity is changed. More precisely, the actual velocity 
regime and the amplitude of the next jump are defined as (alternated) functions of the time 
spent by the particle at the previous state. We assume also that the time intervals between 
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the subsequent state changes have sufficiently arbitrary alternated distributions. It creates 
an effect of damping process where a friction is generated by means of memory. 

This s etting gen eralises processes wh i ch we re used before for market modelling by 
Ratanov (2003) and Lopez and Ratanov ( 20121 ). 



The underlying processes are described in Sections [2ll3l Section H] presents the result 
which can be interpreted as a Doob-Meyer decomposition. Several examples with different 
regimes of velocities and of jumps are presented. 



2. Generalised jump-telegraph processes: distribution 

Let (17, T ^ P) be a probability space. Consider two continuous-time Markov processes 
eQ(t)^E\(t) G {0,1}, t G (—00,00). The subscript i G {0,1} indicates the initial state, 
ej(0) = i (with probability 1). Assume that ej = e.t(t), t G (—00,00) are left-continuos a. s. 

Let {Tn}nez be a Markov flow of switching times. The increments T„ := r„ — t,i_i, n G Z 
are independent and possess alternated distributions (with the distribution functions Fq, 
Fi, the survival functions Fq, Fi and the densities /o, /i). We assume that tq = 0, i. e. the 
state process ei is started at the switching instant. The distributions of and T„ depend 
on the initial state i, i € {0, 1}. For brevity, we will not always indicate this dependence. 

Consider a particle moving on M with two alternated velocity regimes cq and ci. These 
velocities are described by two continuous functions Cj = Ci{T,t), T,t > 0, i = 0, 1. At each 
instant r„ the particle takes the velocity regime Ci,^(j^'^{Tn, ■), where is the (random) time 
spent by the particle at the previous state. We define a pair of the (generalised) telegraph 
processes %■, i = 0, 1 driven by variable velocities cq, ci as follows, 

00 

Toit) = To{t;Co,Ci) = C£o(Tn)(^n, ^ - Tn)l^r„<t<T^+i}, 

"=° t > 0. (2.1) 

Tl{t) = Tl(t;Co,Cl) =^Cej(^„)(r„,t - Tn)l{r„<t<Tr,+ i}, 
n=0 

The integral Ti{s)ds, i = 0, 1 is named the integrated telegraph process. 

Let = Ni{t) := max{n > : r„ < t}, i > be a counting process. Notice that, 
N,{0) = and eo{t) = (1 - (-l)^«W)/2 and ei{t) = (1 + (-l)^iW)/2. 

The integrated telegraph process can be interpreted as the sum of random number of 
random variables. If Aj(t) = 0, then 

t 

J Tiis)ds = k{To;t); (2.2) 


if Ni{t) > 0, then the integrated telegraph process is expressed as 

Ti{s)ds= /^^(^^)(T„;r„,r„+i) + Z,^(^^^j^j)(%(f);T^^(i),t). (2.3) 

'^=0 

Here ^ 

li{T;u,t) := / Ci{T,s)ds, i = 0,l. 

J u 
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Notice that li(T] u, s) + li{T; s, t) = li{T; u, t), i = 0, 1. Simplifying we write li{T; t) instead 
of li{T;0,t). 

In the same manner we define the jump component. Let /iq = h^iT) and hi = 
hi{T), r > be a pair of deterministic continuous (or, at least, boundary measurable) 
functions. Consider telegraph processes (|2.ip based on hi{T) instead of q = Ci{T, •), z = 0, 1, 

oo 

Ti{t;ho,hi) = '^h^^(^^^){Tn)l{r„<t<T„+i}, i = 0, 1. 

n=l 

An integrated jump process is defined in the form of compound Poisson process by the 
integral 

J Ti{s- ho, hi)dNi{s) = /i,,(.„)(T„), i = 0,l. (2.4) 







n=l 



The amplitude of a jump depends on the time spent by the particle at the current state. 

Finally, the generalised integrated jump-telegraph process is the sum of the integrated 
telegraph process defined by ()2.2p - ()2.3p and the jump component defined by ()2.4p : 

t t 

Xi{t) = j Ti{s; Co, ci)ds + j Tiis; ho, hi)dN,{s), t>0, i = 0,l. (2.5) 



It describes the particle which moves, alternating the velocity regimes at random times r^, 
starting from the origin at the velocity regime q. Each velocity reversal is accompanied by 
jumps of random amplitudes, Xi{t) is the current particle's position. 
Conditioning on the first velocity reversal, notice that 

Xo{t) =/o(To;t)l|,,>t} + [/o(ro;ri) + ho{n) + Xi{t - n)] l^^^^t}, 

D ^^■^> 

Xi {t)=h (To ; t)l{r, >t} + [/i (To ; ri ) + hi (n ) + Xo{t - Ti)]l{r,<t}- 

Here = denotes the equality in distribution. At each of two equalities the first term rep- 
resents the movement without velocity reversal; the second one is the sum of three terms: 
the path till the first reversal, the jump value and the movement which is initiated after the 
first reversal. 

The distribution oi X{t), t > is separated into the singular and absolutely continuous 
parts. 

The singular part of the distribution corresponds to the movement without any velocity 
reversals; let P-*^\ i = 0, 1 be the respective conditional distribution, if the initial state 
i = ej(0) is fixed: for any Borel set A we set 

¥f\A) := F{Xi{t) € A, Ni{t) = 0), i = 0, 1. 

We denote the corresponding expectation by E-°^{-}. On the space of (continuous) test- 
functions if consider the linear functional (generalised function), ip E.f''^ {ip{X{t))}. It is 
easy to see that 



MX(t))}= / ^{y)Ff\dy) = F,{t) / p{k{s;t))fi_,is)ds=:<pi{;t;0), if 



> . 
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The generalised function 

POO 

Pi{x,t;0) = F,{t) 6i^^,,t){x)fi.iis)ds = Fi{t) I 6oix - k{s■,t))fl.^is)ds (2.7) 



can be viewed as the distribution "density". Here 5aix) is the Dirac measure (of unit mass) 
at point a. 

The absolutely continuous part of the distribution of Xi(t) is characterised by the den- 
sities 

Pi{x,t;n) = F{Xi{t) € dx, Ni{t) = n}/dx, i = 0, 1, n > 1. 

The sum 



Pi{x,t) = ^pi{x,t;', 



n=l 

corresponds to the absolutely continuous part of distribution of Xi{t), i = 0,1. 

Conditioning on the first velocity reversal, similarly to (j2.6p we obtain the following 
equations, n > 1, 

/oo rt 
/i(r)dr / pi{x -Io{t;s) - ho{s),t - s;n- l)fo{s)ds, 
■'\ (2.8) 

pi{x,t;n)= /o(r)dr / po{x - h{T, s) - hi{s),t - s;n - l)fi{s)ds 
Jo Jo 

(if n = 1 the inner integrals are understood in the sense of the theory of generalised func- 
tions). Summing up in (|2.8p we get the system of integral equations for (complete) distri- 
bution densities, 

/oo rt 
/i(r)dr / pi{x - Io{t;s) - ho{s),t - s)fo{s)ds, 

■'\ (2.9) 

foo r-t ^ ' 

pi{x,t) =pi{x,t;0) + /o(r)dr / po{x - Ii{t, s) - hi{s),t - s)fi{s)ds. 
Jo Jo 

Here po{x, t; 0) and pi{x, t; 0) are defined by (|2.7p . 

If Co, ci = const, ho, hi = const equations (|2.8p and ()2.9p can be solved explicitly using 
the following notations, 

^ = ^(x,t):= ^ and t — ^ = — -. 

Co - Ci Co - Ci 

Notice that < (,{x,t) < t, if x G (cit, cot) (say, cq > ci). Define the functions qi{x,t;n), 
i = 0, 1: for cit < x < c^t, 

^ ,„,„ , ">1, (2.10) 

and 

\n+l \n 

qo{x,t;2n + l)=^^-^e{t-iT 

^ , n>0. (2.11 

qi{x,t;2n + l)=^-j:-^e{t-iT 
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Denote e{x,t) = -l-e-^o?-Ai{t-e)i^^^^^^^_ 
Equations ()2.8p have the following solution: 



Pi{x, t; 0) =e ^'\x - at), 

Pi{x, t; n) =qi{x - jin, t; n)e{x - jin, t), n > I, i = 0, 1, 



(2.12) 



where the displacements jin are defined as the sum of alternating jumps, jj„, = ^^^i hif,, 
where ik = i, if k is odd, and = 1 — z, if k is even. 
Summing up we obtain the solution of (j2.9p : 



Pi{x, t) =e ■5o{x- at) 
1 



+- 



Co - Ci 



XiOix - hi, t)Io 2 



y/XoXijcpt - X + hi){x - hi - at) 
Co - Ci 



+ ^,e{x,t) ('^V'/i f 2y^o^i(^ot-x)(.-cit) 



Cot — X 



Co - Ci 



(z/2)2" 

where /oC-^) = , ^"^^ = -^o(-^) ^'^^ modified Bessel functions. 



nt-o (n!)2 



See the proof of (f2lil]) - (f233]) in lRatanovl ([20071). 



(2.13) 



3. Generalised jump-telegraph processes: moments 

Using (|2.9p the equations for the expectations can be derived also. Let ^i(t) := E{Xj(t)} 
and li{-) :=E{/i(r;t)} = /i„i(r)/i(r; t)dT, t > 0. Equations (US]) lead to 

^H{t) = Fi{t)li{t)+ [ {li{s) + h,{s) + E{Xi_,{t-s)}) fi{s)ds, i = 0,l. 
Jo 

Therefore the expectations /Xj, i = 0, 1 follow the equations of Volterra type: 

l^o{t) =ao{t) + [ l^i{t - s)fo{s)ds, 
Jo 



^i{t)=ai{t)+ / fio{t - s)fi{s)ds, 
Jo 



where 



a^{t) := F,{t)k{t) + {li{s) + h^{s))fi{s)ds, i = 0,l. 
Jo 

Integrating by parts at the latter integral we have 



li{s)fi{s)ds = -F,{t)h{t) + / a{s)F,{s)ds, 
Jo 



which gives the following simplification for functions af. 



ai{t)= / {Fi{s)a{s) + nis)hi{s)) ds. 



(3.1) 



(3.2) 



Here we denote a{s) = E{ci(-; s)} = /i_i(T)cj(T; s)dr, i = 0, 1. 
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Equations for variances cjj(t) := var{Xj(f)} = K{{Xi{t) — can be derived simi- 
larly: 

Mt) =Ht)+ [ (7l{t-s)fois)ds, 

,.t (3.3) 



cTiit) =bi{t) + / aoit-s)fi{s)ds, 

where 







{his) + hi{s) + - s) - fiiit))^ f\{s)ds, i = 0, 1. 







Generalising ()3.ip - ()3.3p . we have the following result. 

Theorem 3.1. Let g = g{x), —oo < x < oo be a locally bounded measurable function. 
Assume that 

/ h-i{T)\g{x + k{T-t))\dT <<x, z = 0,l. (3.4) 

Then the expectations 

Uo{x,t)=¥.{g{x+XQ{t))}, ui{x,t) =W.{g{x + Xi{t))} 
exist, and they satisfy the system 

fOO ft 

uo{x,t) =Go{x,t) + / ui{x + Io{t;s) + ho{s),t - s)fi{T)fo{s)dTds, (3.5) 
Jo Jo 

roo ft 

ui{x,t) =Gi{x,t) + / uo{x + Ii{t;s) + hi{s),t - s)fo{T)fi{s)dTds, (3.6) 
Jo Jo 

where Gi{x, t) = Fi{t) fi^i{T)g{x + li{T; t))dT, i = 0,l. 

Proof. Equations p.5p - ()3.6p follow by conditioning on the first velocity reversal, see ()2.6p . 

□ 

The equations for the moments fi\^\t) := E|Xj(t)^| , t > 0, N > can be derived 
by using Theorem 13.11 with g(x) = x^ , see (|3.5p - (j3.6p . 

Corollary 3.1. Let N = 0,1,2,... 

Functions n'^\t) , fi^^\t) , t > 0,k = 0,1, . . . N satisfy the equations 



/.(^)(t) =Fo{t) fiirMT-,tfdT + f2[^) [ 



go,N-k{s)^i\ '{t - s)fo{s)ds, 
^if\t) =Fi(t)^"/o(r)/i(T;t)^dr + f] l\i,N~k{s)l^''o\t - s)f^{s)ds. 



k=0 

Here 50,0 = 9i,o = 1 and 



00 



9oAt)= / /i(r)(Zo(r;t) + /io(t))™dT, 

^?oo rn>l. 
9i,mit)= / foir)ihir;t) + h,it)rdT, 







In general, systems (|3.ip . (j3.3p and (j3.7p have the form of the recursive Volterra equations 
of the second kind: 

(3.8) 

Jo 

where a[''^\t), i = 0,1 are generated by the preceding moments, /^[^\, /c = 0, . . . iV — 1 : 

■.=Fo{t)J^"°lo{r;tffi{r)dT+Y^ (^) l\o,N^k{s)fiP{t-s)fo{s)ds, 

° ''^^ ° (3.9) 



Af-fc(s)/io - s)/i(s)ds. 



Here N >1. 

System (j3.8p possesses a unique solution, see e.g. iLinz I (jl985l ). Under appropriate 
assumptions the solution can be found explicitly. Consider the following example. Let the 
distributions of interarrival times are exponential: 

fiit) = Xi exp(-Ait), t>0, i = 0,l. 

In this particular case system ()3.8p is solved by 



fx{t) = a{t)+[ {I + ip{t - s)A) La{s)ds, (3.10) 
Jo 

where ip{t) = (1 — e"^'^*)/(2A), 2A := Aq + Ai. Here we use the matrix notations /x = 

ri'".A.r')'.»=(»r,»r')'. 

To check it, notice that system ()3.8p is equivalent to ODE with zero initial condition: 

^ = A,x{t) + cf,{t), /^(0) = 0, 

where cj> = + (L — A)a. We get this equation by differentiating in ()3.8p with subsequent 
integration by parts. Clearly, the unique solution is 



^{t)= / e(*-^)^(^(s)ds. (3.11) 
Jo 

Integrating by parts in (j3.1ip we obtain 

;x(t) = a{t) + [\^'-''>^La{s)ds. 
Jo 

Now, the desired representation ()3.10p follows from 

UM r+^A 1 /Ai+Aoe-2At ^ (i_e-2At)X 

exp{tA} = I + ^{t)A = - i^^ _ ^_2At) + ;,^,-2A* ) ■ (3.12) 
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4. Martingales 

Let Xq = Xo(t) and Xi = Xi{t) be (integrated) telegraph processes defined by ()2.5p on 
the probability space (0,7^, P). Let = E{Xj(t)}, i = 0, 1 denotes the expectations, 

and coefficients aj(t), i = 0, 1 are defined by ()3.2p . 

Notice that by (|3.1|) /io = /^i = if and only if ao = ai = 0, which is equivalent to the 
set of identities, see (|3.2p . 

Fo(t)co(t) + /io(t)/o(t) = 

Fi(t)ci(i) + /ii(t)/i(t) = 0' - • ^ ' ' 

Let J^i, t > be the filtration, generated by {(Xo(s), Xi(s)) | s <t}. 

Theorem 4.1. T/ie integrated jump-telegraph processes Xq and Xi defined by ()2.5p are 
Tt-''TT'<iftingales if and only if (j4.ip holds. 

Proof. The proof can be done by computing the conditional expectation E{Xj(t2)—-^i(ii) | -^ti} 
for < ti < t2- Indeed, 

E{Xi{t2) - Xi{ti) \Ft,} = ¥.l / 7I(s;co,ci)ds + ^ I -^ti > 

[ *i n=7Vi(ii)+l J 



.42 -ti 7V.(i2)-7V>(ii) 



E < 



According to the Markov property applied to the processes ei = £i{t), Ni = Ni{t) and 
{rfc} we have 

e,(ti + s) =e,^(4,)(s), Ni{ti + s)=Ni,{ti)+N,^(^t^){s), s > 0, 

where e(s), N{s), fn and r„ are copies of e{s), N{s), Tn and r„ respectively, independent 
of ■ Therefore, 

Here X^.^^^) denotes the integrated jump-telegraph process, which is initiated from the 
state £i{ti), and is based on e(s), X{s), t„ and T„. The latter expectation is equal to zero, 
K{X,^^ti){t2 - h)} = 0, if and only if (gU) holds. □ 

Remark 4.1. Notice that if ()4.ip holds, then the direction of jump should be opposite to 
the (mean) velocity value. 



Corollary 4.1. If the jump-telegraph processes Xq and Xi defined by (|2.5p are martingales, 
then 

"'^^^ <0 Vt > 0, (4.2) 



hi{t) 

r°° c (s) 

/ -^ds=oo, i = 0,l. (4.3) 

Jo hi{s) 
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Moreover, Xq and Xi are martingales, if and only if the distribution densities of inter- 
arrival times satisfy the following integral relations: 

Mt) = -~^^^pi t'^ds], z = 0,l. (4.4) 



hi{t) [Jo hi{s) 

Proof. Inequality ()4.2p follows directly from (j4.ip . Identities ()4.ip are equivalent to 

Ci{t) fi{t) 



hiit) Fi{t) 



= {lnFi{t)y, i = 0,l. (4.5) 



Therefore 



The latter equality is equivalent to (j4.4p . 

Notice that by definition limt^+oo F'iit) = 0. Hence, condition ()4.3p is fulfilled. □ 

In this framework various particular cases of the martingale distributions and the cor- 
responding distributions of interarrival times can be presented by applying Corollary 14. 1[ 
Consider the following examples. 

Exponential distribution. Assume that functions Cj(t) and hi{t) are proportional: 

|ii|^-A„ A,>0, i = 0,l. (4.6) 

Relations ()4.4p mean that the integrated jump-telegraph process is the martingale if the 
distributions of interarrival times are exponential: fi{t) = Ajexp(— Ajt), t > 0, i = 0, 1. 

Identities ()4.6p can be written in detail as follows. The (observable) parameters of the 
model, i. e. the regimes of velocities co,ci and the regimes of jumps ho, hi, satisfy the 
equations 

Ai / e"^i"co(r,t)dr = -Ao/io(t), Aq / e"^«"ci(T, t)dT = -Ai/ii(t) 
Jo Jo 

with some positive constants Aq and Ai. These equations help to compute the switching 
intensities Aq and Ai by using the (observable) proportion between velocity and jump values. 
On the other hand, if mean velocity regimes are given, cq and ci, from these equations we 
can conclude that small jumps occur with high frequency, and big jumps are rare. The 
direction of jump should be opposite to the velocity sign, see also Remark 14.11 

Proposition 4.1. In the framework of (|2.5p we assume that the Markov flow of switching 
times T = {ta;}^o has interarrival intervals Tk — Tk~i, k > 1 which are exponentially 
distributed with alternated constant intensities fj-o, t-i-i > 0. Let the velocity regimes Ci = 
Ci(t) and jump amplitudes hi = hi[t) are given, and they are proportional as in ()4.6p . 
Ci{t)/hi{t) = -Xi, i = 0,l. 

The martingale measure for {Xq,Xi) exists and it is unique. 

Proof. According to the Girsanov Theorem, see lRatanov we apply Radon-Nikodym 

derivative of the form 



^=£t{X*} = e^py\i{s;cl,cl) 



)ds}K*{t), (4.7) 
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where 

amplitudes h* 



n^i*^(l + (rfe i)) ^® produced by the jump process with constant jump 



"I "C*/A*i5 and Jq 7i(s; Cg, c^)ds is the integrated telegraph process with 
constant velocities c* = fii — Aj. Under the new measure Q the unde rlying Markov flo w 
takes the intensities Aj, i = 0,1 (see Theorem 2 and Theorem 3 by Ratanov ( 20071 )). 

□ 



Therefore, process Xi{t) becomes the martingale. 

Erlang distri bution. Teleg r aph p roces ses with Erlang - distrib uted interarrival times have 



been studied by Perry et al ( 19991 ) and Di C 



yrescenzo 



(l200lh . In our setting, it is easy 



to see that the martingale distribution can be obtained by means of alternated Erlang 

distribution for interarrival times, fi{t) = -^^-txtt^" l{j>o}) = SfcLo i^it) /^h 

[3D, 



Aj > 0, 7ii > 1, 



K-l)! ^ ^it>' 
0, 1, if the velocities and jumps follow the proportion, see 



Ciit)/hiit) 



X'lH^^-^/im - 1)! 



(4.8) 



One can get the martingale measure by changing the intensities of the underlying Poisson 
process (see Proposition 14. ip . 

More precisely, let (O, P) be given probability space. Consider the Poisson flow 
T = {Tfcj^g with constant switching intensities /X0)/^i > 0. Let Qt, t > be a filtration 
based on this Poisson flow. 

We interpret the governing Erlang flow T^"^(t) as thinned Poisson: the system accepts 
each n-th arrived signal. Let Tt be the flltration generated by {T(")(s) : s < i}. Clearly, 
-Fi C Gu Vt > 0. 



All filtrations here are assumed to satisfy the usual hypotheses, see IProtter I ( 20051 ). 

Changing the measure by means of the Radon-Nikodym derivative defined by (j4.7|) 
we pass from intensities /io, Aii to intensities Aq, Ai (defined by ()4.8p ) for the underlying 
Poisson process. Therefore, under the new measure the telegraph process with jumps, 
X = X{t), t > is ^/:-marti ngale. Then X = X{ t \ t > is again martingale, for the 
filtration J-^, see Theorem 2.2, Follmer and Protter ( 201ll ). 

Another particular possibilities are the following. 



1. Weihull distribution. Assuming that 



Ci{t)/hi{t) = -W\ ai > -1, Ai > 0, i = 0, 1, 

we have /i(t) = A^i^^ exp l^^o- 
2. Pareto distribution. Let < Ao,Ai < 2. For bo,bi > assume that 

Ci(t)//ii(t) = -y • l{t>6j, i = 0,l. 

Hence, the martingale distribution is determined by a Pareto distribution for interar- 
rival times, i. e. fi{t) = XibfH~^^^'l[t>bi}, i = 0,1. 

Th is distribution is in the domain of normal attraction of some Aj-stable distribution, 
see lFeller I ()l97lh . 



3. Logistic distribution. Let interarrival times r„, n ^"L have (alternatied) logistic dis- 
tributions with the density fi{t) = (f^;-A/t)2 l{f>o}. see 
(|2010l l. This produces the martingale distribution, if 



Di Crescenzo and Martinucci 



Ci{t)/hi{t) 



A^e-^'* 
1 + e-^'* ' 



t > 0. 
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4. Cauchy distribution. The distribution /j takes the form of Cauchy, such that fi{t) = 

Ut)/K{t) = -^^2 + ^2^(. -'arctan(tM))' * " °' 

5. Uniform distribution. Let 

Ci{t)/h,{t) = - ^^_^ ^o<t<A,- 
Then, in this blow-up case, we have the uniform distribution, = — lo<t<Ai- 
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